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(57) Abstract 



A portable computer arranged to rest comfortably in the hand has a small display screen (5). Accclerome^ g-capable of detecting 
movement of the pen with respect to gravity provide input to a microcontroler which selects from a number of viewing modes a response. 
The pen may be held in either hand and output message to the screen will be oriented according to the location of the pen. Full personal 
digital assistant functionality may be incorporated in a relatively small plastics casing and functions, such as calendar, contacts and the like 
may be incorporated. 
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PORTABLE COMPUTERS 

The present invention relates to portable computers and more particularly 
but not exclusively to hand-held computers of the kind sometimes referred to as 
5 personal digital assistants. 

A personal digital assistant includes data files defining such items as an 
electronic diary, address book and other applications such as word processing 
software, calculators and the like. As more powerful memories and processors 
have been developed in smaller packages it has become possible to provide quite 

10 powerful computiers In relatively small portable cases. However, the limitation of 
miniaturisation occurs when a viewing screen and keyboard are needed for data 
input and read out. Thus, so called palm top personal computers (PPC) are usually 
of the order of 1 5 cm by 7 cm In order to provide a readable screen and a usable 
keyboard. Such palm top computers are known, for example Psion Corporation 

1 5 have produced a Psion Series 5 (trade mark) PPC having an 8 megabyte RAM and 
processor while Hewlett Packard similarly produce PPCs as e.g. the HP320LX 
(trade mark). The capabilities of such PPCs may be enhanced by incorporating so 
called flash cards enabling the expansion of the RAM by up to 1 0 megabytes or 
more while PCMCIA cards may be provided to enable connection of the PPC to 

20 telephone networks by way of cellular 'phones or telephony sockets for 
communication with other computers and the so called Internet and Intranets. 

Most PPCs incorporate a docking arrangement to enable them to be 
connected with a desktop computer or other main frame for the purposes of 
synchronisation of data files and the like. 

2^ However, generally speaking PPCs are not robust and are prone to damage 

mainly because of the clam shell design requiring a hinge that opens to reveal the 
incorporated keyboard and screen. Thus PPCs are more usually used on a desk top 
or table or may be held In one hand while typing with the other. 

According to the present invention there is provided a portable computer 

30 including movement detection means responsive to movement of the computer to \ 
produce an electrical output signal representative of such movement, processing 
means responsive to the output of said position detection means to determine 
detected movement data defining a user's intention, the processing means using 
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said data to provide a mode response Selected from a multiplicity of stored 
possible modes. 

/ Preferably the movement detection means includes at least one 

acceleration or tilt detection means responsive to movement of the computer to 
5 produce the output electrical signal. There may be a plurality of acceleration 
detection means each producing a respective electrical output signal representative 
of movement components in respective directions, the detectors generally being 
mounted to detect X and Y movement components at a ninety degree angle. 

The processing means may include a data input mode in which detected 
10 movement data is used to generate alphanumeric or graphical data. The 
alphanumeric or graphical data may be stored in data storage of the portable 
computer or may be output by transmitting means to receiving means connected 
to another processing device. 

The processing means may include a screen output mode in which 
detected movement data is used to modify ^3itBtrL tn die^hjy inudiis^f th^ 
computer whereby scrolling of dis played informaiion is effecte d^fi-^the screer 
output mode the processing means may be responsive to relative lateral tilting 
movement to cause the display of information stored as to one or other side o 
currently displayed information. Relative rolling movement may cause the display 
20 \ of information stored as above or below the currently displayed information. 

In the screen output mode the processing means may be responsive tc 
detected movement data to determine a most likely orientation of the compute 
display means with respect to a user's eye line whereby the signals output to th^ 
display means may cause inversion of the displayed information such that th 
25 /computer may be held and used in either hand. 

The computer may include proximity detection means arranged to provid 
signals indicative of the proximity of the display screen to a user's view, th 
processing means being responsive to changes in the relative proximity to increas 
or decrease density of displayed information. 
30 In a further development, security data derived from movement of th 

computer defining an authorised user's password is stored, the processing mear 
being locked in a secure mode until detected movement data corresponding to th 
security data is received. 
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The computer may include a sound input device , the processing means 
having a second data input mode in which alphanumeric data is derived from input 
speech signals. A sound output device may also be included to permit the output 
of speech derived from stored data. Alternatively the sound input and output 
5 devices may be combined with a radio transceiver whereby cellular or other radio 
telephony networks may be used. 

The computer may be housed in a casing shaped to facilitate a user 
holding the computer as if holding a writing stylus. The casing is preferably of 
substantially radiused triangular cross section along a substantial portion of its 

10 length and may include a flattened section incorporating a display screen. The 
casing may include angular shaping between a forward holding area and a rearward 
screen area the shaping being such as to provide a natural viewing angle of an 
incorporated display screen while the casing is held as a writing stylus. The 
shaping may also be such as to facilitate support of the rearward screen area by 

1 5 the dorsal aspect of a user's hand between the root of the thumb and index finger 
and the wrist. 

A portable computer in accordance with the invention will now be 
described by way of example only with reference to the accompanying drawings of 
which: 

20 Figure 1 shows a plan view of the computer; 

Figure 2 shows a side view of the computer of Figure 1 : 

Figure 3 is a block schematic diagram of the circuits of the computer of 
Figure 1 ; 

Figure 4 is a circuit diagram showing details of the circuitry described with 
25 respect to Figure 3; 

Figure 5 is a circuit diagram of a docking station to enable the computer of 
Figure 1 to be connected to a desktop or other device; 

Figures 6 to 9 are flow charts showing some of the programs incorporated 
in the microprocessor of Figure 4; 

Figures 10 to 13 are graphical representations of the outputs of the 
accelerometei-s of Figure 4 as analysed by the microprocessor; 

Figure 14 is a graphical comparison of the representations of the outputs 
of the accelerometers as shown in Figures 10 to 13; 
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Figure 1 5 is a schematic diagram of a power saving arrangement of the 
portable computer of Figure 1 ; 

Figure 1 6 is a schematic diagram of a voice input arrangement of the 
portable computer of Figure 1 ; 

5 Figure 1 7 shows mounting positions of the accelerometers of Figure 4 

with respect to each other; 

Figure 18 is a table showing a program response to movement of the 
accelerometers of Figure 1 6 in a particular mode of operation; and 

Figure 19 is a schematic diagram of a part of a scroll detector of the 
1 0 portable computer of Figure 1 . 

Referring to Figures 1 and 2, the hand-held computer of the present 
invention has a case 1 of a moulded plastics material having a triangular barrel 
cross section towards the forward end. that Is towards the point, with radiused 
sides providing a diameter of approximately 15mm. The case is shaped to have a 
1 5 curve so that when the forward part of the barrel of the casing is held as a writing 
stylus using the thumb, index finger and second finger of the user, the screen area 
A-A rests comfortably on the dorsal area at the back of the hand between the root 
of the thumb and index finger of the hand and the user's wrist.. This provides 
some additional support to allow the entire computer to be operated using one 
20 hand only. After assembly the case is sealed using an O-rtng seal much in the 
manner of sealing watch parts. Coating the casing with wax polythene completes 
the sealing of the unit so that to all intents and purposes the case is waterproofed. 

The casing is weighted at one end (for example by including a 
rechargeable battery 2) at the forward end so that if the item is dropped on to a 
25 surface it tends to fall in a specified manner such that the tip which may include 
some impact protection, for example by being rubber cased, prevents any 
significant damage to internal components. The weighting also assists balancing 
of the unit in a user's hand. 

The case may incorporate a hook 3 for attachment of a strap or key ring 
30 (not shown) and may have a pocket clip 4, The hook is preferably recessed within 
the casing. 

Externally mounted a small liquid crystal diode screen which may be of the 
kind manufactured by Batron and supplied under type number BT42003STYC is 
included. To either side of the LCD 5 touch or pressure sensitive switches 6 to 13 



' wo 99/22338 PCT/GB98/03016 



are provided. These switches may be soft programmed to provide functions as 
hereinafter described. A touch scroll strip 14 (hereinafter described) is provided in 
front of the screen 5 and the system includes a pyroelectric detector 15 used in 
determining the proximity of the computer to a user's eye. 
5 Audio input and output devices are also provided together with an alerting 

device. For example, a microphone 16, annunciator 17 and speaker 18 may be 
included. Finger switches 18, 19, 20 are provided forward of the annunciator 17 
and again may be soft programmed for functionality. Also visible are gold docking 
pins 21 used for connecting the hand-held computer for recharging of the battery 2 
10 and transfer of data by way of a docking device to other computers, for example 
desk mounted personal computers. 

As an alternative means of transferring data from the computer of the 
invention to another processing device or to enable the computer of the invention 
to be used as an input device for a PC, an infrared transceiver 22 is mounted 
1 5 towards the front of the casing 1 . 

Also included is a light emitting diode 23 which may be of the kind having 
three or more colours. Individual colours allow for a small amount of illumination or 
may be used to provide indication or alarm functions. Alternatively, a single 
coloured red light emitting diode part TLSH180P from Toshiba may be used. This 
20 ultrabright LED aids human night sight viewing and whilst only being of low power 
may in a dark environment assist the user. 

Turning now to Figure 3, a block schematic diagram of the component 
parts of the computer is shown. It will be noted that the display 5 receives inputs 
from a microcontroller 30 which may be of the type supplied by Microchip under 
25 the reference PIC16C74. The PIC16C74 includes on board read only memory 
(ROM) but in a preferred embodiment an ARM processor with a larger memory is 
used. Also mounted within the casing 1 are two accelerometers 31, 32 which 
may be of the kind known as ADXL05 from Analog Devices Limited and which are 
buffered by operational amplifiers, for example National Semiconductor type 
30 LPC662. The keys 6 to 13 and 1 8 to 20 are here represented as a keypad 33. 
Some of the keys may be used to control a speech recorder 34 which is also used 
as an interface, between the microcontroller 30, and microphone 16 and the 
speaker 18. A radio transmitter 35, which may be a radio transceiver, is also 
incorporated. 
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One function of the radio transmiuer may be to allow use of the hand-held 
computer of the invention as an input device for a desk mounted or other PC 40 
having corresponding receiver 36 and an appropriate converter without physical 
interconnection. Other functions of the transceivers 35, 36 may be apparent from 
the description hereinafter. 

Referring now to Figure 4, the microcontroller 30 is connected to the 
display 5 using standard control inputs of the display to provide a visual output of 
the result of program activities requested by the user. It will be noted that the 
accelero ro e terg — 31 OR d ?? ha v€""assoclated buffer circuits which each include an 
operational amplifier to buffer the input to the microcontroller. The operational 
amplifiers 41 may be type LPC662 from National semiconductor. 

Power to the accelerometers 31 is by way of a transistor TR2 so that if 
the microcontroller 30 determines that no movement of the computer is occurring 
or that the present program does not require use of the accelerometers 31 and 32, 
output RBI may be set to stop current being drawn to minimise battery usage. 
The microcontroller may allow periodic sampling during dormant periods so that if 
the computer is picked up the sensors may again be activated. 

An EEPROM integrated circuit chip type X24F064 8 Kbyte from Xicor 
providing 8 Kbytes of memory is also provided accessible from the microcontroller 
30 in known manr\er. Switches SI to S8 (keys 33 in Figure 3) are wired to 
respective inputs of the microcontroller 30. 

Note that TR1 controls power input to the back lighting circuitry of the 
LCD display 5. Again, the microcontroller 30 will normally bias TRl oft when the 
computer is dormant and will maintain TRl biased off unless back lighting is 
requested by operation of one of the keys of the keyboard 33. 

For the avoidance of doubt it is here noted that the microcontroller 30 
includes a program which uses position outputs from the accelerometers 31, 32 to 
determine from the orientation of the computer whether the hand-held computer is 
in the left hand or right hand of the user. It is here noted that accelerometer 
output may depend upon the tilt angle of the included accelerometers to the 
earth's gravitational field. The keys S1 to SB are then swapped over in soft 
programming mode such that functionality is determined by the apparent top of the 
display 5 to the user in its current position. Similariy, determination of orientation 
of alphanumeric or other display information on the screen b will be determined 
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from the orientation of the computer itself. Thus, data output to the screen from 
the controller 30 arranged to provide an appropriately oriented display. 

The speech recorder 34 is implemented using Sequoia technology sound 
recording integrated circuit type ISD2560. The Sequoia technology chip is capable 
5 of recording 60 seconds of speech message in digital form and is connected so 
that the microphone 16 can be used to provide an input. The three switches SW1, 
SW2 and SW3 may correspond to the fingertip switches 1 8 to 20 of Figure 1 or 
may be selected in software from keys 6 to 13. 

In speech recording mode SW1 provides a start and pause control function 
10 for the user, SW2 is a stop or reset function while SW3 switches between the 
record and play modes. 

Short messages are played back by way of the loud speaker 18. As 
currently implemented the microphone 1 6 is a Maplin type QY62S, the speaker is 
from Hosiden type HDR9941. "Speech notes" recorded by this method may be 
1 5 down loaded to a PC for sorting and categorising. 

Turning briefly to Figure 5, the hand-held computer of Figure 1 can be 
inserted in a corresponding docking port shaped to align the contact 21 with T5 to 
T7 of Figure 5. The contact T5 and T8 provide serial receive and transmit paths 
for synchronising databases between a PC and the portable computer and also 
20 provide battery charging. Contact T7 provides an earth contact. Speech samples 
and other data may be up loaded from a PC to the portable computer. 

A Maxim integrated circuit 42, which may be type MAX232IC, converts 
RS232 level serial output and input required by current PCs to the voltage level 
required by the microcontroller 30 of Figure 4. Note also the ability to receive 
25 radio input by way of an antenna connected to the radio receiver chip type 
AMHRR3-418. 

Having discussed the hardware of the portable computer of the invention 
we shall now consider various uses to which the writing stylus input, voice input 
and screen may be used. Exemplary flow charts for some aspects of the use of 
30 the portable computer are attached. While functions are individually discussed in 
respect of the flow charts of Figure 6 to 9, it will be appreciated that combinations 
of programs may be used in the implementation of features described hereinafter. 

Turning now to Figure 6, the tilt sensor software uses inputs from the 
accelerometers 31, 32 which, as shown in Figure 17 to which reference is 
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] addiiionaily made, are mounted with their respective sensiiive axes at right angles 

j to each other. As will have been seen from Figure 4, the output from each 

i 

accelerometer is filtered by a resistor capacitance network to remote high 
frequency noise for example, and the outputs are then read by an analogue to 
5 digital converter included within the microcontroller 30. Thus, referring to Figure 
6, for special sensing the microcontroller 30. display 5 and analogue to digital 
I conversion circuits are initialised at 100 and the interrupts and port pins of the 

\ microcontroller 30 are reset or cleared at 105. The output of the accelerometers 

: 31, 32 is read from respective arialogue input pins ANO and AN1 of the 

10 microcontroller 30 and an index to a look up table is calculated at step 110 using 
the formula I = a -f (b1 x 16). In this case a is calibration constant and b1 is the 
digitised output of the accelerometer 31. This allows for a look up table allowing 
a1 6 by 16 matrix of left to right position to be determined- For vertical tilt position 
the formula } = a + (b2 x 1 6) where b2 is the output of the accelerometer 32 may 
15 be used to address a further matrix to determine the relative up/down position. By 
applying one or more of the indices to the look up table it, is possible to select one 
of n screen positions or to determine the amount of moverhent since the last 
reading at step 115- The system then waits for 10ms as indicated at step 120 
before repeating the reading of the accelerometer output. 
20 The program allows for the screen 5 to be scrolled in accordance with the 

user's requirements. The mounting of these sensors, as shown in Figure 17, 
allows posiitonal movement such as up, down, left and right to resolved to 
fractions of a degree. 

Using software the microcontroller 30 may use the output from the 
25 accelerometers 31, 32 to determine a user's requirement for a different view to be 
displayed on the screen 5. Thus a virtual hinge is created such that if the user 
moves the stylus whilst it is in viewing position the screen information may be 
changed to respond to a natural reaction for looking up or down or to the left or 
right. Thus, as shown in Figure 18 in a simplified arrangement, if the display on 
30 the screen at any time is designated as current page (CP), then tilting the stylus 
towards the left will cause the display of a page stored as lo the right of CP (CR). 
The page which was formerly CR (as represented by data held within the storage 
of the microcontroller 30 or an associated data store) is now CP, Tilting the stylus 
lo the nght will cause a page of information (CD to the left of CP to be displayed. 
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For the avoidance of doubt the term page is used here as for a screen for 
information. Thus the action of tilting the stylus to the left or right is analogous to 
the natural inclination to look through a window towards the right or left to obtain 
additional information from a scene. 
5 Similarly, if the stylus is turned towards the user information stored at UC 

will be displayed and tilting the stylus away results in the information DC being 
displayed. It will be appreciated that combining tilt angles may result in the display 
of information up and to the left (UL), up and to the right (UR), down and to the 
left (DU and down and to the right (DR). This simplified description of a multiple 
O line screen moving as if a jump is occurring should be considered as allowing single 
line scrolling in which CP defines the top line of the screen, DC the line below and 
further lines to the limit of screen viewability also being displayed with CP such 
that single line scroll movement or smooth scrolling appears to occur. Finer 
scrolling modes such as single pixel movements are also possible. The user may 
5 select the rate of response using keys 6 to 13 or fingertip switches 18 to 20. It 
should also be noted that the tilt sensor arrangement 31. 32 allows the 
microcontroller 30 to determine the most likely viewing angle and to adjust pixel 
mapping to the screen accordingly so that if a user holds the stylus in the left hand 
the display is inverted to that shown in Figure 1 so that the bottom right corner, as 
0 viewed by a right handed user, becomes the top left corner as viewed by a left 
handed user. It should be noted that the microcontroller does not require an input 
from the user to determine whether the stylus is being held in the left or right hand 
and, if a user changes hands during the course of viewing the screen output will be 
inverted accordingly. 

5 It is also possible, particularly if pictorial rather than alphanumeric display 

is required, for the screen to enter a "portrait" mode if the stylus is held vertically. 
In this case the orientation will be appropriate to the stylus being held with its tip 
above or below the waist of the stylus. 

To prevent scrolling or orientation change the user may use a soft key 6 to 

3 1 3 or fingertip switch 1 8 to 20 to lock and unlock display movement. 

Further, while as described with reference to Figure 3, the display screen 
is a Batron. in a preferred embodiment a Kopin Cyberdisplay 320 having % VGA 
colour resolution may be used. Using the Kopin display and the associated 
monocular viewing lens mounted end on to the body allows clear viewing of some 
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1 5 lines of normal text. The Kopin Monocular lens is approximately 20mm by 
ISmrn which gives an acceptable size to a pen body incorporating movement 
sensing means as herein described. 

In a sTill further development the pyroelectric detector (Murata type IRA- 
5 E700STO) 1 5 may be used to detect the presence of the user and the proximity of 
The user to the viewing screen 5. Using the Kopin 'A VGA display it is possible to 
decrease the size of character displayed. Thus the microcontroller 30 uses the 
output of the pyroelectric detector 1 5 to determine how close to a user's eye the 
stylus is held and may adjust the size of print so that more characters are fitted on 
10 the screen 5. In this way large areas of text may be read by holding the screen 
close to the user's eye, A further use of the pyroelectric detector for power saving 
purposes it discussed hereinafter. As has been mentioned detection of the 
position of the screen with respect to the user's left or right side is possible. 

Referring to Figure 8, clearing of interrupt and set port pins and 
15 initialisation as previously mentioned with regard to Figure 6 is carried out. One of 
the accelerometers, for example the accelerometer 31, is read at step 200 and its 
value compared with a predetermined value m. Values greater than m indicate that 
the display is most likely in the user's left hand so that as indicated at 215 
inverted characters are displayed on the screen 5. If the value read from 
20 accelerometer 31 is less than m then it may be assumed that the stylus is in the 
user's right hand and normal ROM LCD characters are displayed. As indicated at 
220, a check may be carried every 10ms to determine the whereabouts for the 
screen. 

It is envisaged that input to the computer system either for use as a PDA 
25 or for word processing purposes, will be carried out either by hand writing 
recognition fHR) or by voice input using the microphone 16. Handwriting 
recognition does not require the user to write on a surface, although some users 
may find this a preferable method of operation, but requires the user merely to 
move the stylus (that is the whole computer) as if writing letters and numbers. 
30 Katakana or Cyrillic texts may also be entered as may symbols. 

Thus using one of the two accelerometers 31, 32 and referring to Figures 
10 to 14, the output of one. of the accelerometers 31, 32 is read at a simple rate 
of 100 times per second. The received data is stored in a random access memory 
(RAM) buffer as a set of acceleration values against unit time. Using a software 
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process of autocorrelation the microcontroller 30 may determine the character 
entered. Thus, referring to the Figures, Figure 10 shows three entries of the letter 
C, Figures 11 shows three entries of letter B, Figure 12 3 entries of letter F and 
figure 1 3 three entries of letter H for exemplary purposes only. Feedback to the 
5 user either on the display or by character speech output or simply by an acoustic 
beep indication may be used to note acceptance of a character. The validity 
indication may be user selectable. 

It will be noted from Figure 14 that a single accelerometer output is 
distinct for each of the input characters and therefore the microcontroller can 
10 determine the entry made. The entry may be of text which can be reflected to the 
viewing screen 5 or maybe instructions couched in appropriate terms such as "get 
Monday diary". Once the diary has been recovered from the store the appropriate 
entries may be displayed on the screen 5 with appropriate soft key indications for 
the keys 6 to 13. 

15 Note that predefined user gestures such as drawing an "envelope" to 

request e-mail mode or a table for diary mode, for example, may be used. The 
instructions may be user selectable or teachable so that on initialisation the user 
draws and selects the mode. Subsequently drawing the same symbol will cause 
the microcontroller 30 to enter the appropriate selected mode. 

20 Again sensing may be used to move around the displayed area (as 

discussed with reference to Figure 6 and Figure 18) or the touch strip controller 14 
may be used in combination with the keys 6 to 13 to select appropriate areas. 

Entry of information to the diary may also be by handwriting input. It is 
convenient here to consider the construction of thjB touch strip 14 which as shown 

25 in Figure 19 comprises a 0.4mm printed board having a surface area of 
approximately 20 mm by 5m with horizontal strips in the 5mm dimension as 
indicated as 47 to 50 for Figure 19 which shown a part of the strip 14. The strip 
14 thus replaces the rotational elements of potentiometer so that hermetic sealing 
of the casing may be complete and a control which is resistant to wear as 

30 provided. The strips 47 to 50 etc, are interfaced to the microcontroller 30 so that 
as a finger is moved across the strip direction of movement and speed of 
movement may be determined. The information may be used in the same way as 
a rotary potentiometer. 
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It will be appreciated that incorporating a second strip at right angles to 
the strip 14 would allow full functionality of leg) a computer mouse to be 
simulated. 

Thus as shown in figure 19, if a user moves a finger such that, for 
5 example, the presence of the finger bridging 48. 49 and 50 subsequent to the 
presence of a finger bridging 47 to 50 indicates that the user would wish to rotate 
a potentiometer in a counter-clockwise direction. Similarly, detection of a finger 
bridging 47 and 48 subsequent to there having been no previous bridge indicates 
rotation in a clockwise direction. 
^° appreciated, however, that if the tilt detection mechanism 

hereinbefore described indicates that the device is in the left hand rather than the 
light hand the functionality of bridging and unbridging is reversed accordingly. 

Entry of data files, for example the composition of letters or reports can be 
^ carried out using either the write sensing arrangement, hereinbefore described, to 
1 5 determine input alphanumeric which may be stored for subsequent transmission to 
a printer or for transfer as data files to a PC for example. Data entered and 
converted into appropriate stored Information may be displayed on the display 
screen if required. 

Cursor movement around the display scr«en to select a position to which 
20 information is to be placed may be by use of either the poTentiometer arrangement 
described with reference to Figure 19 or by use of tfie tilt sensing mechanism 
hereinbefore described in combination with one of the soft keys to indicate that an 
insert or delete position is being selected. 

In an alternative method of operation and referring to Figure 7 and initially 
25 to Figure 7a. use of the stylus of Figure 1 as a non-connected input device for a 
PC allows all of the functions of the hand held computer to be duplicated. For 
example, where alphanumeric data is input in the manner previously described with 
reference to Figures 10 to 14 a more powerful PC may be able to affect 
autocorrelation much more rapidly than the microcontroller 30 of the device Itself. 
30 III this case, referring specifically to Figure 7a, once The initialisation process has 
been completed at 100, one or both of the accelerometers may be read at 705 at 
10ms intervals as indicated at step 710 and the voltage data is transferred to the 
serial pon for transmission by the wireless link or by use of infrared transmission. 
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A corresponding program in the PC itself will read from radio receiver 36 
and the receive port the data defining the voltage from one or both the 
accelerometers: Autocorrelation will be carried out on the reading to generate 
appropriate characters at step 725. the characters being displayed on the PC 
5 screen at step 730 and possibly being transmitted back to the hand-held PC. 

In an alternative implementation autocorrelation may be carried out within 
the microcontroller 30 and data defining input characters themselves be 
transmitted to the PC. 

Note that the transmission of comma separated variables (CSV) format 
10 ASCII is traiSsmitted at 418 MHz using an amplitude modulated radio transmitter 
from RF Solutions of Lewes East Sussex UK. In the PC CMOS voltage levels 
converted by the RS232 conversion unit can be used to provide raw data to the 
PC. Windows 3.1 terminal software is capable of reading CSV data and 
spreadsheet can read and plot data graphically. 
''^ ^ ^"•^'^e'- "se of the accelerometer 31, 32 arrangement password 

protection of the hand-held computer may be provided. Thus, once trained to a 
user's signature, for example, a stored waveforrn corresponding to accelerometer 
voltage outputs read at 10ms intervals can be used. Thus the user does not 
require to remember any special passwords and cracking of the signature code is 
20 extremely difficult since, for example forging a signature will result in a different 
acceleration pattern to that of the natural signature writer. 

Thus it may be possible to use a hand-held computer of this nature to 
provide transmission of security information for. for example, electronic point of 
sale authorisations, access restriction and the like. 

^ further use of the transmission and reception capability allows a 
local area paging system to be developed. Thus if several users work in 
reasonable proximity to each other it is possible to transmit message directly from 
one hand-held computer to another such that, for example, telephone messages 
taken by one person in an office and files created may be transmitted using a 
30 digital serial identity to another specified hand-held computer unit. 

Turning to Figure 1 6, in addition to the simple 60 second voice note 
storage chip 34;" the microphone 18 may also be connected by the amplifier and 
filter arrangements to proviije voice input to the microcontroller 30. Voice 
recognition software can thus be used to convert the voice input to. data, the keys 
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or fingertip switches 1 8 to 20 having appropriate use for pause, record, etc as 
hereinbefore described with reference to the spoken memorandum chip. 
Converted data can thus be transferred to the memory or displayed on screen or as 
hereinbefore described with reference to using pen input for handwriting 
5 correlafon by a PC serial data to the PC representing the voice input can be 
provided. This is indicated at 39. 

in an alternative method of working, the microcontroller causes storage of 
the speech input in the memory 38 without effecting conversion, the information 
being transmitted via the serial output port either in the docking station or by the 
10 radio link to a PC which may use voice recognition software to carry out the 
conversions. It may be preferable to use a PC to carry out the conversion rather 
than a microcontroller incorporated in the pen since significant processing power 
may be required. However, the inclusion of voice recognition software in the 
microcontroller 30 is possible. 
15 It will also be realised that a data store may be used to store received 

speech signals. Thus several speech notes each time/date stamped may be held 
for subsequent use. If a suitable store is included then the speech storage chip, 
hereinbefore described, may be omitted from the stylus to allovy additional memory . 
chip space. 

that since the hand-held computer of the invention includes 
microphone, loudspeaker and function keys use of the device as a cellular 
telephone is also envisaged. 

Where cellular phone functionality is included within the stylus or where 
the stylus is in contact with a PC for example by IRDA or radio transmission, the 

25 use of the microphone input for substantial dictation purposes is possible and also 
The use of substantially larger data files than could otherwise be stored locally. 

Thus the input speech will be stored in a buffer by the microcontroller 30 
and periodically, when the buffer contains a substantial amount of data, a network 
connection to either network data storage means or to a predetermined PC is 

30 effected. Stored buffered data is then transferred to the remote location. Since 
the network connection is not permanently required the cost of transferring the 
data by this means is less significant and periods of network signal weakness can 
be overcome. 
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Data buffered in this manner may be date and time stamped or, if the 
stylus incorporates GPS (global positioning systems) may be location stamped also. 

Data may similarly be recovered such that large text documents required 
by a user may have portions stored in the buffer for display and sequential 
5 recovery of other parts of the document from the remote location using telephony 
as required. Photographic data, for example from a digital camera, may similarly 
be saved to the network by way of the buffered store. 

The various functions above described enable the provision of a full PDA 
function including diary alarm and scheduling functions as well as data input, file 
10 creation and storage. The user may select the mode of operation using either soft 
buttons or movement input and the use of the accelerometers 31, 32 is 
determined from the mode selected by the user. Electronic mail and fax facilities 
may be incorporated in the PDA functions allowing reception or transmission of 
data via the unit. The transmission capability of the unit may be associated with a 
15 receiver In a printer for example or a printer incorporating a docking station may be 
used to allow the printing of data from the PDA. Note that infrared transmission 
may be used. 

As will be appreciated one of the major problems with any hand-held 
portable device is the use of rechargeable batteries which have a limited power life 

20 between charges. The hand-held computer of the present invention therefore 
incorporates a number of power saving facilities arranged particularly to close 
down back lighting of the small LCD screen 5 if it is not appropriate. Thus if the 
accelerometers indicate that there is no current usage of the system then powering 
down of the detection circuitry and back lighting of the screen may occur. 

25 However, in a further use of the proximity detector 15, it is possible to turn back 
lighting on and off in dependence upon whether the user is looking information on 
the screen or not. Thus, referring to Figure 15, the pyroelectric detector 
conversion detects presence of movement to maintain back lighting. Pyroelectric 
detectors tend to detect presence of a person by movement through a parallel 

30 beam of infrared such that when movement is detected across a Fresnel lens an 
AC signal is generated. 

Thus the pyroelectric system can be used to detect the presence of a user 
and in the absence of use power down of the back lighting at least may occur. 
Infrared sensors may similarly be used to detect the presence or absence of body 
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heat. Note the pyroelectric detector, as previously described, can be used to 
control the character zoom iPeature hereinbefore described- A suitable detector is a 
Murata type IRAE700STO. 

In a further implementation of back lighting power down which is 
5 responsive to the viewer's vision in addition to the viewer's presence. It is known 
that when a subject looks directly at a lens and a flash occurs blood vessels at the 
rear of the eyes reflect back to the camera. It is thus possible to periodically flash 
a low level light and to sense red reflection using a photodiode sensor- Thus as 
shown at Figure 1 5, the microcontroller 30 periodically causes an LED 60 to pulse. 
10 At the same time a photodiode 61 I's monitored and, assuming presence of a user's 
eye 62 reflecting light from the pulse, the LCD will remain back lit as indicated at 
58- It is further noted that a custom-built solar cell (not shown), for example a 
Solarex available from Farnell Electronics, may be used to assist triple charging of 
the battery 2. 

15 If a user is not looking directly at the screen at the time the LED 60 is 

flashed there will be no reflection and the photodiode 61 will not activate. The 
microcontroller may therefore power down the back light 58 thus reducing the 
drain on the rechargeable battery 2. 

Although the present invention has been described with reference to a 

20 particular implementation using accelerometers other position detection and 
location means may be used to implement movement detection arrangements. 
While herein references made to alphanumeric data it will be appreciated that 
katakana character and Cyrillic script inputs may also be detected using the 
acceleration method hereinbefore described- 

25 Note when the hand-held computer is docked with a PC or is receiving 

data by way of cellular or radio transmission it is possible to display received 
information on the screen 5. Thus as indicated at Figure 9 and initialisation 
message is output to the screen 5 and appropriate buffer is cleared. As characters 
are received at the serial port are transferred to the microcontroller at 905 and 

30 checked for frame validity at 910. Assuming that there is no error at 910 and that 
the received character is not a clear screen message as indicated at 915 then a 
character is transferred to the LCD 5 tor display at 920. 

Further possible uses of the portable computer of the invention includes 
storing large numbers ot speech modes which when down loaded to a PC with the 

i 
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pen either in a docking station or by IRDA or radio transmission are sorted. In this 
process the; PC converts the each of the speech notes to text and scans the text 
for frequently occurring words, for example "meeting" and then sorts the stored 
notes into sub-directories. Alternatively, notes may be sorted by date, subject 
5 matter or size as will occur with a normal windows file. Key control words such 
as "alarm" may result in the speech note being converted into a timed alarm which 
may then be written back to the portable computer so that at the appropriate time 
the portable computer either announces the alarm or a vibrate to alert the user, the 
alarm being displayed as a text message. It will be appreciated that if a 

10 sufficiently powerful microcontroller is used in the pen then the speech to text 
conversion may take place in the portable computer unit. A suitable vibrating 
motor for use' as a silent alarm can be obtained from Murata of Japan. Situating 
the annunciator towards the barrel of the pen near the tip improves transmission. 

The microcontroller may cause audio feedback of the current position of 

15 the stylus, for example by causing sounds of flicking pages when the pen is tilted 
forward or back. 

While most emphasis herein has been on the display of alphanumeric. 
Katakana or Cyrillic characters, graphic information may also be viewed. For 
example, a file holding pictures related to a person may include three dimensional 
20 picture of that person's face. By revolving or tilting the computer the view may 
switch from a front view to a profile aspect. It will also be appreciated that an 
atlas may be stored in the data store and maps may be rotated to align with the 
direction of travel for example. 

Additional functionality may be introduced to the hand-held computer by 
25 including a touch screen in front of the display screen such that a stylus can be 
used to select text or to cause localised movement of a cursor. 

An autolocate function may be built into the microcontroller such that if no 
movement, ie no change in tilt of either the enclosed accelerometers occurs for a 
selectable period, probably 24 hours, the unit will sound an alarm at periodic 
30 intervals so that the user can locate it. 

Note that the tilt sensors included herein measure tilt with respect to 
earth's gravity by use of a small beam arrangement. Other position sensors may 
be included. Global positioning by satellite is also a possible method of detecting a 
change in the position of the portable computer. 



"OCIO: <;VVO_gs22338A1 I > 



^0/10 '01 TI 13:24 FAX +358 9 69395785 

\: 

t 



PRH LUKUSALI 



l^Ull 



- wo 99/22338 PCT/GB98/03016 

18 . 

i 

Jn a symbol coumed mode it is possible for a user to flick the pen either as 
a Tick or a cross, for example, in relation to a submitted document. The number of 
licks or crosses may be counted and the result accumulated and transferred to 
data store or accumulated in a spreadsheet to which the user may input names, 
5 lilies and the Jike. The use of other symbols in anticipated. 

While as hereinbefore described the security signature is by use of 
acceleration, a pressure detector may be incorporated into the end of the device to 
further increase security by measurement of the profile as well as the two 
dimensional or three dimensional spatial sensor, 

''O As has been mentioned hereinbefore, a number of keys, switches and 

buttons are provided on the casing of the portable computer. In a further 
implementation an on/off switch may be provided operated by pressure on the 
"nib-end". Whilst such switch pressure is not used for detecting input text per se, 
it may be used to turn functions on and off. This may be used in a normal writing 

15 mode, for example, touching the pen tip against a writing surface to turn on the 
accelerometer detection functions. Releasing pressure on the tip then stops the 
accelerometer signals being considered as potential input to be decoded. 

Any of the other switches may be used in certain modes to turn on or off 
text detection, for example, or to stop screen scrolling for example. 

20 Calculator functions in the portable computer may be provided simply by 

writing the numerals and appropriate mathematical symbols in the normal manner. 
The tilt sensor software will determine the numerals and characters entered and 
perform an appropriate calculation for display on the display screen. 

A further function, for example for clock setting causes display of an 

25 analogue clock face on the display means 5. Time changes may be entered by 
selecting an appropriate mode and moving the user's wrist. Tilt sensing is used to 
determine forward or backward adjustment of the time stored. 
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CLAIMS 

1 . A portable computer comprising movement detection means responsive to 

movement of the computer to produce an electrical output signal representative of 
5 such movement, processing means responsive to the output of said position 
detection means to determine detected movement data defining a user's intention, 
the processing means using said data to provide a mode response selected from a 
multiplicity of stored possible modes. 

10 2. A portable computer as claimed in claim 1, in which the movement 
detection means comprises at least one acceleration detection means responsive 
to movement of the computer to produce the output electrical signal. 

3. A portable computer as claimed in claimed 2. in which a plurality of 
15 acceleration detection means each producing a respective electrical output signal 

representative of movement component in respective directions are provided. 

4. A portable computer as claimed in claim 3, in which the detectors are 
mounted to detect x and y movement components at a 90» angle to each other 

20 

5. A portable computer as claimed in any one of claims 1 to 4. in which the 
processing means includes a data input mode and detected movement data is used 
to generate alphanumeric or graphical data. 

25 6. A portable computer as claimed in claim 5, in which the generated 

alphanumeric or graphical data is stored in a data store. 

7. A portable computer as claimed in claim 5. in which the alphanumeric or 
graphical data is output by transmitting means to receiving means connected to 

30 another processing device. 

8. A portable computer as claimed in any preceding claim, in which the 
processing means includes a screen output mode in which detected movemem 
data is used to modify output to display means of the computer. 
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23. A portable computer as claimed in claimed in ciaim 22 in K- . 
processing means is .spons.e .o receive, encode, radio T.n fs o T 
paging alert. signals to activate 

5 24. A portable computer as claimed in Cain, 23. in w«ch ,^ 

comprises a tone. wmcn ine page alen 



25. 



comori. * """"" " '"'""^ ""^ «^ MB.-n9 aier, 

comonses a operation of a vibrating means 

10 



26. 



A portable computer as claimed in any of claims 22 ,o 25 in which * 
processing means causes the disol.v o< ° 
received. ' ' ""''"'^ "'^ formation 

1 5 27. A portable computer as claimed in any preceding claim, housed in a casino 
Shaped ,o facilitate a user holding .ha computer as a writing styius. 

a red,usad tnanguiar cross-section along a substantial portion of its iengL 

fluened* "T"'^ """"" -iudes a 

flattened secfon Incorporating a display screen. 

2S a'n°gular iT't -^ng includes 

angular shap,ng between a forward holding „ea adapted to rest in the user's 
ngers and rearward flattened area hoiding , display screen the shaping be,' g c 

1 nVis : : ' """" "'"""^ 3=te.„ wh . the 

casing is held as a writing stylus. 

" t'e raarwa,r™"° — 
rearward screen are, to be supported by the dorsal areas of a user s hand. 
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16. A portable computer as claimed in any preceding claim, in which the 
processing means stores data defining an authorised user's password, the 
processing means being locked in a secure mode until detected movement data 
5 corresponding to the security data is received. 



17. 



A portable computer as claimed in any preceding claim, further comprising 
a sound input device, the processing means being responsive to voice input signals 
from a user to derive alphanumeric data. 



10 



18 



A portable computer as claimed in any preceding claim, including a sound 
output device, the processing means being arranged to provide output of speech or 
other sound signals derived from stored data. 

15 19. A portable computer as claimed in claim 17, further including a sound 
output device in combination with a radio transceiver whereby cellular or radio 
telephony networks may be used, 

20. A portable computer as claimed in any one of claims 1 to 8, including 
20 radio transmission or infrared transmission means, the processing means being 

responsive to detected movement data to output to the transmission means signals 
representative of the detected movement. 

21. A portable computer as claimed in any one of claims 1 to 8, including 
25 radio transmission or infrared transmission means, the processing means being 

responsive to detected movement data to output to the transmission means signals 
representative of alphanumeric characters. 

22. A portable computer as claimed in any preceding claim, including radio 
30 transceiver means, the processing means being responsive to detected movement 

data which identifies another device to cause the transmission of coded signals 
including a message for display. 
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9. A portable computer as claimed in claim 8, whereby detected movement 
data is used to effect scrolling of displayed information such that portions of data 
defining alphanumeric or graphic information outside a currently displayed screen 

5 may be selected by the user. 

10. A portable computer as claimed in claim 9, in which a relative lateral tilting 
movement causes the display of information stored as to one or other side of the 
currently display information. 

10 

11. A portable computer as claimed in claim 9 or claim 10, in which relative 
rolling movement causes the display of information stored as above or below the 
currently displayed information. 

15 12. A portable computer as claimed in any one of claims 8 to 11, in which the 
processing means is responsive to detected movement data to determine a most 
likely orientation of the computer display means, the processing means causing the 
displayed information to be oriented accordingly, 

20 13- A portable computer as claimed in claim 12, in which a plurality of switch 
means responsive to user action is included adjacent to the display means, the 
respective function of each of the switch means being oriented to match the 
orientation of displayed information. 

25 14. A portable computer as claimed in claim 12 or claim 13, comprising a 
touch sensitive static potentiometer strip responsive to movement of a users finger 
to simulate movement of a potentiometer, the orieniation of said potentiometer 
reflecting the orientation of the displayed information- 

30 15. A portable computer as claimed in any one of claims 8 to 14, including 
proximity detection means which provides signals indicative of the proximity of the 
computer display screen to a user's view, the processing means being further 
responsive to changes m relative proximity to increase or decrease the density ol 
displayed information. 
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